SECURITY 

MARKING 


The  classified  or  limited  status  of  this  report  applies 
to  each  page,  unless  otherwise  marked. 

Separate  page  printouts  MUST  he  narked  accordingly. 


THIS  DOCUMENT  CONTAINS  INFORMATION  AFFECTING  THE  NATIONAL  DEFENSE  OF 
THE  UNITED  STATES  WITHIN  THE  MEANING  OF  THE  ESPIONAGE  LAWS,  TITLE  18. 
U.S.C.,  SECTIONS  793  AND  794.  THE  TRANSMISSION  OR  THE  REVELATION  OF 
ITS  CONTENTS  IN  ANY  MANNER  TO  AN  UNAUTHORIZED  PERSON  IS  PROHIBITED  BY 
LAW . 


NOTICE:  When  government  or  other  drawings,  specifications  or  other 
data  are  used  for  any  purpose  other  than  in  connection  with  a  defi¬ 
nitely  related  government  procurement  operation,  the  U.  S.  Government 
thereby  incurs  no  responsibility,  nor  any  obligation  whatsoever;  and 
the  fact  that  the  Government  may  have  formulated,  furnished,  or  in  any 
way  supplied  the  said  drawings,  specifications,  or  other  data  is  not 
to  be  regarded  by  implication  or  otherwise  as  in  any  manner  licensing 
the  holder  or  any  other  person  or  corporation,  or  conveying  any  rights 
or  permission  to  manufacture,  use  or  sell  any  patented  invention  that 
may  in  any  way  be  related  thereto. 


THE 

TECHNOLOGICAL 

INSTITUTE 


D  DC 

TOP'-  ^ 

U  0C1  5  1965  | 

,  Ulaw  —  -  «  -auJ 


DOC- MW  I 


NORTHWESTERN  UNIVERSITY 


EVANSTON,  ILLINOIS 


SYSTEMS  RESEARCH  MEMORANDUM  No.  136 


The  Technological  Institute 


The  College  of  Arts  and  Sciences 


Northwestern  University 


ONE-PASS  ALGORITHMS 
FOR  SOME  GENERALIZED 
NETWORK  PROBLEMS 

by 

A.  Charnes  and  W.  M.  Raike 


August  1965 


Part  of  the  research  underlying  this  report  was  undertaken  for  the  Office  of 
Naval  Research,  Contract  Nonr-1228(10),  Project  NR  047-021,  for  the  U.  S. 
Public  Health  Service,  Divisions  of  Water  Supply  and  Pollution  Control  and 
Environmental  Engineering  and  Food  Protection,  Contracts  WP  00019-06  and 
EF  00355-03,  and  for  the  U.  S.  Army  Research  Office  -  Durham,  Contract 
No.  DA-31-124-ARO-D-322,  at  Northwestern  University.  Reproduction  of 
this  paper  in  whole  or  in  part  is  permitted  for  any  purpose  of  the  United 
States  Government. 

SYSTEMS  RESEARCH  GROUP 
A.  Charnes,  Director 


Introduction 


The  generalized  network  model,  or  problem,  ([l  ])  and  the  closely 
related  restricted  dyadic  problem  ([  i])  (called  the  generalized 
"transportation"  problem  in  [8])  are  two  of  the  most  frequently 
encountered  special  model  types  occurring  in  applications  of  linear 
programming.  Although  they  are  next  in  order  after  pure  network  or 
distribution  models  with  respect  to  ease  of  computation,  the  jump  in  degree 
of  difficulty  is  such  that  up  to  the  present,  at  any  rate,  there  exist  no 
algorithms  for  them  comparable  in  speed  or  efficiency  to  those  for  pure 
network  or  distribution  problems.  Vet  examples  abound  in  which  some 
additional  special  structure  to  these  generalized  models  facilitates 
solution  to  the  extent  that  one  expects  solution  methods  to  exist  which 
involve  little  more  computational  effort  than  the  pure  cases.  Often,  too, 
these  special  structures  may  be  part  of  larger  or  more  complicated  models 
of  the  same  general  type. 

For  such  reasons,  the  development  of  special  efficient  techniques  for 
identification  and  solution  of  any  significant  subclasses  is  an  important 
task.  We  address  ourselves  to  it  from  the  viewpoint  of  the  generalized 
network  model  because  of  the  additional  insight  offered  by  the  associated 
topological  structure.  Thus,  in  this  paper  we  designate  by  topological 
properties  two  special  subclasses  which  permit  evolution  of  efficient 
algorithms.  These  follow  by  extensions  of  methods  of  Charnes  and  Cooper 
and  of  Dijkstra  for  the  corresponding  pure  network  problems.  We  obtain 
easily  implemented  algorithms  which  provide  an  optimum  in  one  "pass"  through 
the  network.  The  proofs  provided  for  these  extended  theorems  differ  in 
character  from  those  provided(or  not  provided) in  the  more  special  "pure" 
problem  algorithms  published. 

A  (pure)  network  is  an  oriented  connected  graph  with  the  following 
additional  featuresj  associated  with  each  link  (or  arc)  is  not  only  a 
direction  but  a  price,  and  with  each  node  (or  vertex)  a  quantity 
representing  a  supply  or  demand,  borne  commodity  is  regarded  as  flowing  along 
the  links  from  nodes  at  which  a  supply  is  present  to  nodes  at  which  there 


is  some  demand;  flow  on  any  link  produces  a  per  unit  revenue  in  the  amount 
given  by  the  price  on  that  link.  Capacitated  networks,  meaning  networks 
in  which  there  is  an  upper  bound  to  the  flow  on  each  link,  are  not  considered 
here,  (bee  [l] ,  [6] . ) 

Such  a  network,  having  m  nodes  and  n  links,  can  be  described  by  its 
incidence  matrix  A,  an  m  x  n  matrix  in  which  the  column  (corresponding 

to  link  j)  contains  a  -1  in  row  k,  a  +1  in  row  q,  and  zeros  elsewhere  when 
link  j  leads  from  node  k  to  node  q.  An  m-vector,  b,  contains  in  its  ith 
position  the  supply  (with  a  -  sign)  or  demand  (with  a  +  sign)  associated 
with  node  i  ;  the  n-vector,  c,  contains  in  its  position  the  unit  price 

associated  with  link  j. 

If  it  is  desired  to  maximize  total  revenue  while  satisfying  the  supply 
and  demand  restrictions,  the  optimal  flow  pattern  x  is  the  solution  to 
the  linear  programming  problems 

Maximize  c^x 

( 1 )  Subject  to  s  Ax  =  b 

x  >  0  , 


where  x  - 


Xj  being  the  flow  on  link  j.  There  exist  many 


variations  on  this  theme;  for  example,  some  of  the  equations  in  (1)  may  be 
replaced  by  inequalities. 

A  generalized  network  differs  from  the  above  in  that  the  nonzero  entries 
in  A  are  not  required  to  be  +  1  ,  although  it  is  still  required  that  each 
column  have  exactly  two  nonzero  entries  which  are  of  opposite  sign.  It  is 
clear  that,  by  appropriate  scaling  of  the  columns  of  A  and  the  corresponding 
elements  of  c,  an  equivalent  problem  may  be  obtained  in  which  the  negative 
element  in  each  column  of  A  is  equal  to  -1.  The  positive  element  in  the 

column  of  A  will  be  denoted  kj.  The  flow  on  link  j  may  be  regarded  as 
producing  revenue  in  the  amount  c^x^  and  then  being  subjected  to  amplification 
(or  attenuation)  by  the  factor  kj.  Thus  these  numbers  represent,  in  the 
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terminology  of  electrical  engineering,  "gains"  associated  with  each  link.  ^ 
In  its  present  generality,  the  above  model  includes  as  a  special  case 
the  model  dubbed  "generalized  transportation  problem"  in  [7],  [g]  and  [9], 
which  is  a  special  instance  of  the  "dyadic"  models  discussed  in  [1]  and  [2j  . 

.'Je  shall  restrict  our  attention  to  a  more  special  situation*  henceforth 
we  assume  that  the  generalized  networks  under  discussion  have  the  following 
special  features: 

(a)  Exactly  one  node  (the  "sink")  has  nonzero  demand,  and 

th  2/ 

this  node  will  be  designated  as  the  m  ‘  node. 

(b)  Exactly  one  node  (the  "source")  has  nonzero  supply,  and 
this  node  will  be  designated  as  node  1. 

(c)  There  is  an  unlimited  supply  at  the  source*  this  means 
that  the  first  constraint  in  Ax  =  b  is  the  equational 
equivalent,  i.e. ,  incorporates  the  slack  variable  for, 

n 

I  a.  .  x  >  -M 
j=l  10  j  " 

wherein  M  is  as  in  the  regularization  techniques 
described  in  [1]  an  element  from  the  Hilbert  extension 
field;  it  may  be  thought  of  as  representing  a 
"sufficiently"  large  positive  number. 

Henceforth,  (1)  will  be  understood  to  incorporate  these  features. 

It  should  be  remarked  that  condition (c)  above  is  by  no  means  a  weak 
assumption,  and  we  should  indicate  some  reasons  for  its  adoption.  In  the 
pure  network  case,  we  know  that  the  rank  of  the  incidence  matrix  A  is 
always  m-1  ;  in  the  case  of  a  generalized  incidence  matrix  representing  a 
connected  network,  all  that  can  be  said  in  general  is  that  the  rank  is 
either  m-1  or  m.  (bee  appendix.)  If  A  has  full  rank,  it  is  in  general 


bee  [  5). 

This  condition  can  he  dispensed  with;  see  the  discussion  of  Algorithm  2. 
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necessary  when  implementing  adjacent-extreme-point  linear  programming 
techniques  to  maintain  a  basis  consisting  of  columns  of  A  which  will  then 
contain  m  columns.  The  links  represented  by  such  columns  can  no  longer  form 
a  so-called  spanning  tree  for  the  network;  any  collection  of  m  links  in  a 
network  containing  m  nodes  must  necessarily  contain  a  loop,  and  it  is  just 
such  loops  which  are  the  source  of  difficulty  in  developing  algorithms  for 
the  general  problem.  Assumption (c)  effectively  forces  the  first  constraint 
to  be  redundant,  which  is  a  "reasonable"  substitute  for  the  convenience  of 
having  A  to  be  of  rank  m-1  . 

Even  thus  restricted,  the  problem  still  includes  many  matters  of  interest 
such  as  PERT,  or  critical  path  scheduling,  models.  Charnes  and  Cboper  ^ 
gave  a  "directed  subdual  method"  for  the  pure  network  case  of  the  problem, 
i.e.,  PERT  networks.  It  should  be  emphasized,  however,  that  such  networks 
have  the  additional  property  that  the  relation  <  between  node  pairs  (i,j) 
determined  by:  "  i  <  j  if  there  is  an  oriented  path  from  node  i  to  node  J" 
determines  a  consistent  strong  partial  ordering  of  the  nodes;  i.e.,  is 
antireflexive,  antisymmetric  and  transitive.  A  pure  network  of  the  type 
described  above  is  a  PERT  network  if  and  only  if  the  nodes  form  a  lattice 
under  the  <  relation.  The  procedure  given  by  Charnes  and  Cooper  is  valid 
only  for  such  networks;  if  we  allow  ourselves  to  assume  that  this 
property  is  present,  there  is  a  direct  extension  of  their  directed  subdual 
method  to  the  case  of  a  generalized  PERT  network,  which  we  give  here. 

Algorithm  1 

We  solve  the  dual  problem  to  (1)  which  is  to  determine  an  m-vector  w 
which  solves: 

Minimize  **b 

(2)  Subject  to:  *TA  >  cT 

Wj  <  0  ,  all  other  w^  unrestricted  in  sign, 


1/ 


bee  [3] 
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or  as  the  problem  appears  with  our  assumptions, 


Minimize  -w,  M  +  w  b 
1  mm 

m 

(3)  Subject  to:  Z  w.  a..  >  c.  ,  j=  1 ,  ...,n 

i=  1  1  J 


w  <0 


in  which  b  >  0  is  the  demand  at  node  m,  the  sink, 
m 

Now  duality  theory  assures  us  that  if  there  is  a  finite  optimum  to  (1) 

there  is  also  a  finite  optimum  to  (3);  furthermore,  the  optimal  values  of 

the  two  functionals  are  equal.  Therefore,  if  (1)  has  a  finite  optimum  we 

must  have  w.  =  0.  Henceforth  for  ease  of  reference  we  shall  call  w.  the 
^  ^  J 

node  potential  associated  with  node  j  (corresponding  to  the  j  row  of  A). 

The  algorithm  is  as  follows.  First  discard  any  node  other  than  the  source 

or  sink  which  has  only  links  leading  into  (or  out  of)  that  node,  also 

discarding  these  links;  since  no  flow  can  occur  over  such  links,  there  can 

be  no  feasible  solution  if  the  network  becomes  disconnected  by  this 

procedure. 

(i)  Assign  a  node  potential  of  zero  to  the  source  node. 

(ii)  Let  p(j)  =  (nodes  i*  there  is  a  link  leading  from  i  to  j]  , 
and  denote  by  c^  and  k^  the  price  and  gain  of  each  link  (i,j) 
leading  to  j  from  some  i  f  p.(j)»  Select  for  use  in  ( i i i )  any  node 
s  such  that  all  immediate  predecessors  of  s  (i.e. ,  all  i  e  p(s)  ) 
have  been  assigned  node  potentials. 


(iii)  Assign  w  = 


max 


i  e  p(s) 


“i  *  ci. 


and  record  the  link  (i,s)  for 


which  the  maximum  occurs.  If  the  maximum  is  taken  on  for  more 
than  one  (i,s)  ,  select  any  one  to  be  recorded. 

(iv)  If  the  sink  has  been  assigned  a  potential,  stop;  otherwise,  go 
back  to  (ii). 

It  remains  to  show  that  the  algorithm  is  executable,  that  it  terminates 
and  that  a  unique  path  from  source  ♦n  sink  is  determined  by  the  links 
recorded  in  (iii)  which  will  yield  the  maximum  total  revenue. 
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Now  suppose  that  the  lattice  property  holds*  then  the  nodes  can  be  parti¬ 
tioned  into  classes  where  Q^m]  ,g2=p(Q1 ) . .  ,Q^=p(Q^_1 ) . .  ♦Qt=P(Qt_1 )  >  in 
which  p(Q.)  =  inodes  i:  i  precedes  r  for  some  r  e  Q.  and  i  f.  Q.  for  k=l,...,j) 
and  where  the  are  disjoint.  ("p(Q)"  is  mnemonic  for  "predecessor  of  Q". ) 

It  is  clear  that  we  may  apply  the  algorithm  by  assigning  potentials 
successively  to  all  nodes  in  ,  then  to  all  nodes  in  ,  etc.,  without 

any  ambiguity;  the  procedure  must  then  terminate  after  at  most  m  steps.  It 
is  equally  clear  that  the  links  recorded  in  (iii)  contain  a  unique  path  from 
source  to  sink,  since  at  each  node  exactly  one  link  entering  that  node  is 
recorded.  When  the  sink  has  been  assigned  a  potential  this  path  is  found  by 
looking  backward  from  the  sink  to  its  recorded  predecessor,  then  to  its 
recorded  predecessor  and  so  on  until  the  source  is  reached.  The  flow  along 
this  path  is  then  easily  calculated;  suppose  the  path  consists  of  the  links 
,  J2  ****»jr  where  jL  =  (l,i2),  j2  =  ( i2 , ig) ,  Jr  =  (ir»m)  . 

b  x . 

Then  x.  =  m  and  x.  =  Ji+ 1  ,  for  i  =  r,r-l,...,l.  (All  flows  are 

■^r  k .  ^  i  k , 

Jr  Ji 

zero  for  links  not  on  the  path.)  It  may  be  verified  that  these  x^  do  indeed 
constitute  a  feasible  solution  to  the  problem  (1);  moreover,  a  tedious  but 


r 

straightforward  calculation  shows  that  Z  c.  x.  =  w  b  .  It  follows 

1=1  h  .h  "  m 

that  the  given  flows  and  w^  constitute  optimal  solutions  to  (1)  and  (3) 
respectively  if  the  node  potentials  w^  form  a  feasible  solution  to  the  dual 
problem  (3).  Upon  reflection,  however,  it  is  apparent  that  the  w^  computed 


by  setting  w^  =  0,  w^ 


max 

i  e  p(j) 


wi  + 


actually  do  form  a  feasible 


solution  to  (3).  For  then  w^  >  *i  *  Cii  ,  or  w^k^-w^  cij*  ^or  *  e  P(J)» 

kij 

These  relations  are  precisely  the  constraints  in  (3)  formed  by  the  columns  of 
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\A  !  corresponding  to  links  (i,j)  for  i  e  p(j).  Consideration  of  these  for 
all  j  indicates  that  all  dual  constraints  are  indeed  satisfied.  The 
validity  of  Algorith  1  is  thus  established. 

Algorithm  2 

The  more  general  procedure  which  we  present  here  is  an  extension  for 
1-source  generalized  networks  of  a  method  of  Dijkstra  for  determining  the 
shortest  path  between  two  vertices  of  a  graph.  ^  '.»e  develop  the  algorithm 
only  for  networks  for  which  conditions  (a) ,  (lb) ,  (c)  hold,  but  it  will  be 
clear  from  the  proof  of  its  validity  that  it  is  also  applicable  for  networks 
which  do  not  satify  condition(a) ,  i.e.,  "multi-sink"  networks,  since  it 
actually  provides  an  optimal  path  from  the  source  to  any  node.  The  optimal 
flow  will  then  be  obtained  by  superimposing  the  flows  which  would  be 
obtained  by  considering  each  sink  separately.  (Any  node  at  which  there  is 
positive  demand  will  be  designated  as  a  sink.)  Algorithm  1  also  possesses 
this  wider  scope. 

Consider  the  minimization  problem: 

Minimize  c^x 

(4)  Subject  to:  A  x  =  b 

x  >  0 

which  is  to  be  understood  to  incorporate  conditions  (a) , (b) , (c)  mentioned 
previously.  (A  maximization  problem  may  be  converted  to  one  in  which  the 
objective  is  minimization  by  reversing  the  signs  of  the  c^  .)  Whereas 
here  we  do  not  require  the  quite  restrictive  lattice  property  needed  for 
Algorithm  1  ,  two  completely  different  conditions  are  imposed: 

(d)  All  Cj  are  assumed  nonnegative. 

(e)  For  all  j  ,  k^  <  1  . 

Condition (e;  is  fairly  stringent;  it  in  effect  ensures  that  the  optimal  path 
has  no  directed  subpath  leading  from  any  node  back  to  itself  (i.e., 
"feedback")  even  though  it  may  be  possible  to  form  such  loops  within  the 
network. 


1/ 


See  [4]  ,  in  which  the  method  is  stated  without  proof. 
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In  contrast,  condition(d)  is  usually  no  restriction  whatever.  Often 
ad  hoc  methods  suffice  to  obtain  an  equivalent  problem  in  which  all 


c  .  ;•  0 ; 


at  the  very  worst,  all  that  is  needed  is  any  dual  feasible  solution 


with  Wj  -  0  in  order  to  implement  the  following  specialization  of  a  more 
generally  applicable  technique  for  effecting  a  transformation  to  a  problem 
with  nonnegative  c^.  ^ 

buppose  that  some  dual  feasible  solution  w  is  available  with  w^  =  0  . 

The  modified  objective  function  c^  =  c^  -  w^A  must  have  all  c.  >  0  since  the 

IT  J  ~ 

dual  constraints  w  A  <  c  are  assumed  satisfied  by  w.  Moreover,  the  only 

effect  of  this  transformation  is  to  add  a  constant  to  the  original  functional 
I 

c  x,  since 


T  at  -T 
Cx-cx=wAx 


( 0  ,w_  ,  •  •  •  ,  w  ) 
l  m 


constant. 


\ 


In  terms  of  the  network  data,  this  means  simply  that  w^k..  -  w.  should 

A  J  ^ 

be  subtracted  from  c.  .  to  obtain  the  new  c. .  ,  all  of  which  will  then  be 

U  iJ 

nonnegative.  (The  double  subscript  notation  has  the  same  meaning  as  before.) 

Prior  to  application  of  the  algorithm  we  assume  that  certain  nodes  and 
links  which  are  irrelevant  to  feasible  solutions  have  been  deleted. 
Specifically,  these  are  any  nodes  other  than  the  source  and  sink(s)  at  which 
there  are  only  outbound  (or  only  inbound)  links,  and  also  these  links.  If 
this  deletion  disconnects  the  network,  or  if  there  are  only  inbound  links  at 
the  source  or  only  outbound  links  at  the  sink(s),  then  there  can  be  no 
feasible  flow  pattern.  Similarly,  links  leading  into  the  source  or  out  of 
the  sink  may  be  immediately  discarded.  (There  may  be  no  feasible  solution 
even  if  these  conditions  are  not  present;  such  a  situation  will  however 
become  evident  in  the  course  of  applying  the  algorithm.)  The  procedure 


i/ 


,'le  develop  this  general  technique  el^owheio  together  with  other 
significant  appl i rations. 
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is  then  as  follows. 

(i)  Assign  a  node  potential  of  zero  to  the  source;  circle  the  source 
(or  otherwise  denote  the  fact  that  its  potential  is  to  remain 
fixed  hereafter). 

(ii)  Suppose  the  most  recently  circled  node  is  i. 

Let  s(i)  =  [nodes  jj  there  is  a  link  from  i  to  j  and  node  j 

is  uncircled}; 

this  is  the  set  of  immediate  uncircled  successors  to  i.  If 
s(i)  is  empty,  proceed  immediately  to  (iii);  otherwise, 
for  each  j  in  s(i),  do  (a)  or  (b)  below; 

(a)  If  j  has  not  been  previously  examined, 

set  w.  =  1  ii  . 


(b)  If  a  value  ^  has  already  been  set  for  j,  reset  this 


value  to 
min 


A 

"j  * 


VLlu 


(iii)  Examine  all  nodes  which  have  been  assigned  a  potential  but  which 
are  uncircled;  choose  one  such  uncircled  node  which  has  the  least 
potential  and  circle  it  —  say  this  is  node  q.  If  there  are  no  such 
nodes  and  if  the  sink  (any  sink,  if  there  are  several)  is  uncircled, 
then  there  is  no  feasible  path  from  the  source  to  the  sink(s)  and 
the  process  terminates. 

Now  for  some  immediate  predecessor  p  of  q  the  relation 

w  =  Wp  *  Cpq  holds.  Record  the  link  (p,q)  for  which  this  is 
^  k 

pq 


the  case;  if  there  is  more  than  one,  choose  any  such  link.  A 
unique  path  from  the  source  to  each  circled  node  is  now  contained 
in  the  list  of  recorded  links.  If  all  sinks  have  been  circled,  an 
optimum  is  at  hand;  if  some  sink  has  not  yet  been  circled,  go 
back  to  (ii). 


-10- 


We  must  establish  the  validity  of  the  algorithm*  it  is  clear  that  it 
terminates  after  at  most  m  repetitions  of  this  process.  It  remains  to  show 
that  it  terminates  either  with  a  correct  indication  of  infeasibility  or 
with  attainment  of  an  optimum. 

First,  suppose  that  at  some  point  there  are  no  uncircled  nodes  which 
have  been  assigned  (tentative)  potentials.  Also  suppose  that  some  sink  is 
uncircled.  Since  at  each  stage  in  step  (ii)  all  successors  to  the  most 
recently  circled  node  are  assigned  potentials,  the  class  L  of  nodes  which 
have  beer  assigned  potentials,  whether  circled  or  not,  is  exactly  that  class 
T  of  nodes  for  which  one  is  guaranteed  that  there  exists  a  path  from  the 
source  to  any  member  of  T.  In  our  case,  L  contains  only  circled  nodes, 
implying  that  there  are  no  uncircled  successors  to  any  node  in  L.  But  all 
nodes  not  in  L  are  uncircled.  Therefore  there  exists  no  path  from  any  node 
in  L  to  any  node  not  in  L.  Since  the  source  is  always  in  L  and  we  have 
supposed  that  some  sink  is  uncircled,  hence  not  in  L,  there  can  be  no  path 
from  source  to  sink,  and  infeasibility  has  thereby  been  exhibited. 

For  ease  of  reference,  we  assume  that  one  of  the  sinks  is  chosen  to 
remain  fixed  throughout  the  following  discussion}  we  can  then  speak  without 
ambiguity  of  "the"  sink.  Now,  ruling  out  infeasibility,  suppose  that  the  sink 
has  been  circled.  Since  the  list  of  recorded  links  contains  a  path  from  the 
source  to  every  circled  node,  it  certainly  contains  a  path  from  source  to 
sink.  Because  only  one  link  leading  into  a  circled  node  is  recorded  and  no 
link  entering  the  source  or  leaving  the  sink  is  recorded,  such  a  path  can 
contain  no  loops  (subpaths  leading  from  some  node  back  to  itself).  Such  a 
path  must  therefore  be  unique.  The  flow  along  this  path  may  be  computed  in 
the  manner  of  Algorithm  1. 

The  matter  now  remaining  is  to  show  that  the  path  obtained  is  an  optimal 
path,  i.e. ,  whose  flow  pattern  yields  an  optimum  for  the  problem  (4).  This 
will  be  done  indirectly;  once  we  have  shown  that  the  final  w^  constitute 
an  optimal  solution  to  the  dual  of  (4),  the  same  computation  indicated  for 
Algorithm  1  proves  that  the  functional  values  for  the  two  dual  problems  are 
equal  and  therefore  that  the  obtained  flow  pattern  is  optimal  for  problem  (4). 

To  show  that  the  path  obtained  is  dual  optimal  we  shall  show  that  the  path 
to  any  circled  node  (obtained  from  the  list  of  links  recorded  in  (iii)  )  is 
optimal  for  a  problem  which  consists  of  designating  that  circled  node  as  the 
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actual  sink  and  hence  for  the  problem  (4). 

Suppose  we  were  to  designate  the  source  node  as  the  sink.  Since  w^  =  0, 
this  is  an  optimal  solution  to  the  dual  subproblem  consisting  of  the  source 
node  alone.  Now  suppose  that  the  collection  of  circled  nodes  at  some  stage 
contains  r  members,  and  that  the  circled  w^'s  for  all  such  nodes  represents 
an  optimal  solution  to  all  of  the  dual  subproblems  obtained  by?  (1) 
considering  all  circled  nodes  and  all  links  joining  two  circled  nodes,  and 
(2 y  by  successively  considering  each  circled  node  to  be  the  sink.  This 
supposition  is  true  for  r  =  1  by  the  above  comment.  We  shall  show  that  the 
process  of  circling  the  (r  +  l)-st  node  assigns  it  a  w^  ^  which  is  optimal 
for  the  subproblem  obtained  by  considering  all  r+1  circled  nodes  and 
supposing  that  the  (r  +  l)-st  node  is  the  sink?  this  induction  then  yields 
the  desired  result. 

Let  p*(r  +  1)  =  ^ nodes  j»  j  is  circled  and  there  is  a  link  from  j  to  r  +  l}. 
Since  we  are  to  circle  r  +  1,  this  means  that  the  circled 

,  or  k.  .  ,  w  .  .  -  w.  <  c.  .  , 
j,r«-l  r+1  j  -  j,i+1 

so  that  these  dual  constraints  are  satisfied.  (Recall  that  in  the  dual  to  (4) 
the  objective  is  maximization  and  that  the  inequalities  are  reversed  from 
those  in  (3).  )  Moreover,  the  w^ ^  thus  chosen  is  the  largest  possible  one 
which  satisfies  these  restrictions.  It  only  remains  to  show  that  the 
dual  constraints  corresponding  to  any  links  leading  from  r  +  1  to  a 
previously  circled  node  are  also  satisfied,  i.e.,  that 

k  ,  .  w.  -  w_,  <  c.  .  .  for  all  circled  j  such  that  there  is  a  link  from 
r»l,j  j  r+1  -  r+l,j 

r+1  to  j.  Consider  any  such  j,  and  suppose  node  r  was  the  node  circled 

immediately  prior  to  the  circling  of  r  ♦  1.  If  we  can  show  that 

wj  <  wr  we  will  be  finished,  since  the  same  argument  will  prove  that 

w  -  w  ,  <  0  and  hence  w.  -  w_,  <  0  since  all  w.  are  nonnegative  by 
r  r+  1  -  j  r+ 1  -  i 

construction.  Since  all  c^  >0,  this  implies  that  w^  -  w^^  -  Vi.j  50 
that,  hacause  0  <  <  1  ,  also  kwl  J  . }  -  Vl  <  „  deslred. 

Suppose  q  is  the  q-th  node  circled  and  q  +  1  the  (q  +  l)-st.  We  show 
inductively  that  wq  <  w^j  j  this  is  obviously  true  for  q  =  1  since  w1  =  0. 


r+1 


min 


j  e  p  (r+1) 


w.  +  c,  , 

j  hnl 

k .  . 

j,r+l 
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There  are  two  cases j  either  there  is  a  link  from  q  to  q  +  1  or  not.  In  the 

yy  +  C 

first  case  we  have  w  .  .  >  o  a .0*1  >  w  ,  so  w  <  w  .  .  .  If  there  is 

q+i  -  ^ - q  q  -  q^l 

q  »q+ 1 

no  link  from  q  to  q  ♦  1,  consider  the  situation  immediately  before  q  is 
circled;  both  q  and  q  ♦  1  must  have  been  assigned  potentials  but  have  been 
uncircled.  If  w^  >  w^ ^  then  it  would  be  impossible  to  choose  node  q  to  be 
circled  next  since  the  minimum  of  such  uncircled  w.  is  always  used  to 
select  the 
which  then 
above;  the 


next  node  to  be  circled.  Hence  we  must  have  w  <  w_,  , 

q  -  q*i 

establishes  that  w^  <  wf  as  was  needed  to  complete  the  proof 
validity  of  Algorithm  2  is  thus  established. 
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Appendix 

Rank  of  a  Generalized  Incidence  Matrix 


We  consider  a  generalized  incidence  matrix  C  representing  a  connected 
generalized  network;  i.e.  ,  C  has  precisely  2  nonzero  entries  per  column,  and 
the  network  has  the  property  that  there  is  a  path  consisting  of  a  sequence  of 
links  of  the  network  (possibly  with  their  orientation  reversed)  which  connects 
any  two  given  nodes  in  the  network.  Clearly  then,  for  a  network  having  m 
nodes  and  n  links,  C  is  m  x  n  and  connectedness  implies  n  >m  -  1  . 

Theorem  m  >  rank  (C)  >  m  -  1 


Proof  Rank  (C)  is  always  less  than  or  equal  to  m;  to  show  that  rank 
(C)  >  m  -  1  we  show  that  the  submatrix  obtained  by  deleting  any  row  of  C 
has  full  rank,  by  showing  that  any  such  m  -  1  rows  are  linearly  independent. 

Delete  any  row  of  C  (this  corresponds  to  the  deletion  of  some  node), 
and  partition  the  remaining  rows  (nodes)  into  two  classes,  A  and  B,  such 
that  A  contains  all  rows  containing  "singleton"  elements  and  B  contains  all 
other  rows;  i.e.  ,  row  i  is  in  A  if  and  only  if  it  contains  the  only 
nonzero  entry  in  some  column  of  ($  .  Now  suppose  that  there  exist 


i  '  j 

,  not  all  zero,  such 

that 

(1) 

ml  i  m2 

X  a.  A  +  Z 

i=l  1  j=l 

Bj  *  0  , 

where  A*  (B^)  is  the  i-th  (j-th)  row  of  A  (B)  and  uij  +  =  m  -  1  . 

The  system  (1)  embodies  n  equations;  by  the  definition  of  A  and  B  there 

are  m,  of  these  (corresponding  to  columns,  say,  k(l) ,... ,k(i) ,... ,k(m, )  of /a\  ) 
1  1  iBi  • 


such  that  B^  =0  for  j  =  l,...,m0  and  i  =  l,...,m.  ,  since  otherwise  row 
k(i)  *  A 

BJ  would  be  in  A.  Therefore,  from  *hese  (unit  vector)  columns  we  obtain  the 


m,  equations 
1  m 


I*  a.  A*  =  0  ,  or  by  the  singleton  character  of  A, 

i=l  1  MU 


k(i) 


=  0  and 


hence  a.^  =  0 


for  i  =  1,... ,m. 
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Next,  by  connectedness  of  the  network,  there  must  be  a  link  from  some 
node  in  the  collection  represented  by  A  to  one  in  the  collection 
represented  by  B  (or  vice  versa),  since  by  construction  there  are  no  links 
between  the  deleted  node  and  the  nodes  of  B.  In  other  words,  there  must 
exist  a  column  q  of  with  one  nonzero  entry  in  one  of  the  first  m^ 
positions  and  the  other  in  the  (m^  +  k)-th  position,  for  some  k.  Recalling 
that  all  <1^=0,  equations  (1)  become: 


(2) 


m2  . 

Z  p,  =  0  ,  i=l,...,n  . 

j=l  3 


The  column  q  just  mentioned  ensures  that  one  such  equation  reduces  to 
k  k  / 

p,  B  =  0  where  B  f  0}  hence  jl.  =  0  . 
k  q  q  k 

Now,  switching  row  k  from  B  to  A  and  renaming  ^  as  am  ,  the 

preceding  argument  employing  the  connectedness  property  of  the  network 
may  be  repeated  until  all  rows  have  been  exhausted.  We  obtain  thereby 


that  all  jij  =  0.,  and  hence  the  rows  o f  1^1  are  linearly  independent. 
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